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which the whole of flavour mixing for quarks is determined by the mechanism 
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the Anti-grand Unification Theory and, in particular, the neutrino mass and 
mixing problem. 
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1 Introduction 

1 reviewed the general problem of the quark-lepton mass spectrum at the first 
Bled workshop on “What comes beyond the Standard Model” [li]. So, in this 
talk, I will mainly concentrate on two topics: the Lightest Flavour Mass Gen¬ 
eration model and the Neutrino Mass and Mixing problem in the Anti-Grand 
Unification Theory (AGUT). 

2 Lightest Flavour Mass Generation Model 

A commonly accepted framework for discussing the flavour problem is based 
on the picture that, in the absence of flavour mixing, only the particles belong¬ 
ing to the third generation t , b and r have non-zero masses. All other masses 
and the mixing angles then appear as a result of the tree-level mixings of fam¬ 
ilies, related to some underlying family symmetry breaking. Recently, a new 
mechanism of flavour mixing, which we call Lightest Family Mass Generation 
(LFMG), was proposed [||. According to LFMG the whole of flavour mixing 
for quarks is basically determined by the mechanism responsible for generating 
the physical masses of the up and down quarks, m u and respectively. So, in 
the chiral symmetry limit, when m u and vanish, all the quark mixing angles 
vanish. Therefore, the masses (more precisely any of the diagonal elements of 
the quark and charged lepton mass matrices) of the second and third families 
are practically the same in the gauge (unrotated) and physical bases. The pro¬ 
posed flavour mixing mechanism, driven solely by the generation of the lightest 
family mass, could actually be realized in two generic ways. 

The first basic alternative (I) is when the lightest family mass (m u or m^) 
appears as a result of the complex flavour mixing of all three families. It “runs 
along the main diagonal” of the corresponding 3x3 mass matrix M, from 
the basic dominant element M 33 to the element M 22 (via a rotation in the 2-3 
sub-block of M) and then to the primordially texture zero element Mu (via a 
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rotation in the 1-2 sub-block). The direct flavour mixing of the first and third 
quark and lepton families is supposed to be absent or negligibly small in M. 

The second alternative (II), on the contrary, presupposes direct flavour mix¬ 
ing of just the first and third families. There is no involvement of the second 
family in the mixing. In this case, the lightest mass appears in the primor- 
dially texture zero Mu element “walking round the corner” (via a rotation in 
the 1-3 sub-block of the mass matrix M). Certainly, this second version of the 
LFMG mechanism cannot be used for both the up and the down quark families 
simultaneously, since mixing with the second family members is a basic part of 
the CKM quark mixing phenomenology (Cabibbo mixing, non-zero V c b element, 
CP violation). However, the alternative II could work for the up quark family 
provided that the down quarks follow the alternative I. 

Here we will just consider the latter scenario. 

2.1 Quark Sector 

We propose that the mass matrix for the down quarks (D = d, s, b) is Hermitian 
with three texture zeros of the following alternative I form: 

/ 0 ar> 0 \ 

M d = a* D A d b D (1) 

V 0 b* D b d ) 

It is, of course, necessary to assume some hierarchy between the elements, which 
we take to be: B D A D ~ \b D \ \ar>\. The zero in the (M D ) n element 
corresponds to the commonly accepted conjecture that the lightest family masses 
appear as a direct result of flavour mixings. The zero in (Md ) 13 means that 
only minimal “nearest neighbour” interactions occur, giving a tridiagonal matrix 
structure. 

Now our main hypothesis, that the second and third family diagonal mass 
matrix elements are practically the same in the gauge and physical quark-lepton 
bases, means that : 


Bd =rrib + 6 d Ad =m a + 5' D ( 2 ) 

The components 5d and d' D are supposed to be much less than the masses of 
the particles in the next lightest family, meaning: 

|d_D|<?n s \6' d \ <^m d (3) 

Since the trace and determinant of the Hermitian matrix Md gives the sum and 
product of its eigenvalues, it follows that 

6 d — -m d (4) 

while S' D is vanishingly small and can be neglected in further considerations. 
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It may easily be shown that our hypothesis and related equations (|| -1^) are 
entirely equivalent to the condition that the diagonal elements (Ad, Bd ) of Mn 
are proportional to the modulus square of the off-diagonal elements (an, bo)- 


Ad _ aD 
Bd bn 


( 5 ) 


Using the conservation of the trace, determinant and sum of principal minors 
of the Hermitian matrices Md under unitary transformations, we are led to 
a complete determination of the moduli of all their elements, which can be 
expressed to high accuracy as follows: 


( 0 

\M d \ = y/m d m s 

V o 


y/m d m s 0 

m s s /m d m b 
y/m d mb mb - m d 


( 6 ) 


Now the Hermitian mass matrix for the up 
following alternative II form: 


quarks is taken to be of the 


/ 0 0 Cu \ 

M v = 0 A v 0 (7) 

\c*u 0 BuJ 


The moduli of all the elements of Mjj can also be readily determined in terms 
of the physical masses as follows: 

( 0 0 yjm u m t \ 

0 m c 0 (8) 

yjm u m t 0 m t — m u ) 


The CKM quark mixing matrix elements can now be readily calculated by 
diagonalising the mass matrices Md and Mu- They are given by the following 
simple and compact formulae in terms of quark mass ratios: 


m d 


\V US \ = = 0.222 ±0.004 \V US \ = 0.221 ± 0.003 


m s 


m d 


\Vd,\ = J— = 0.038 ±0.004 \V cb \ exv = 0.039 ±0.003 


m b 


\V u b\ = J— =0.0036 ±0.0006 I V ub \ exj> = 0.0036 ± 0.0006 


(9) 

( 10 ) 

( 11 ) 


As can be seen, they are in impressive agreement with the experimental values. 


2.2 Lepton Sector 


The MNS lepton mixing matrix is defined analogously to the CKM quark mixing 
matrix: 


U = U„U E f 


( 12 ) 
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Here Ue and U v are the unitary matrices which diagonalise the charged lep¬ 
ton mass matrix Me and the effective neutrino mass matrix M u respectively. 
Assuming the charged lepton masses follow alternative I, like the down quarks, 
the LFMG model predicts the charged lepton mixing angles in the matrix Ue 
to be: 



These small charged lepton mixing angles will not markedly effect atmospheric 
neutrino oscillations, which appear to require maximal mixing sin 2 2 9 a t m — 1- 
Similarly, in the case of the large mixing angle (LMA) MSW solution of the 
solar neutrino problem, they are essentially negligible. It follows then that the 
large neutrino mixings should mainly come from the U„ matrix associated with 
the neutrino mass matrix. 

According to the “see-saw” mechanism, the effective mass-matrix M v for 
physical neutrinos has the form 

M v = -M^M^ n M n (14) 

where Mm is their Dirac mass matrix, while Mmn is the Majorana mass ma¬ 
trix of their right-handed components. Matsuda et al || have extended the 
alternative I LFMG texture to the Dirac Mm and Majorana Mmn matrices. 

The eigenvalues of the neutrino Dirac mass matrix Mm are taken to have a 
hierarchy similar to that for the charged leptons (and down quarks) 

Mn3 ■ Mm 2 : Mmi — 1 : y 2 ■ y A , y ~ 0.1 (15) 

and the eigenvalues of the Majorana mass matrix Mmn are taken to have a 
stronger hierarchy 


Mnn3 ■ Mnn2 ■ Afivjvi — i '■ y 4 '■ y 6 (16) 

One then readily determines the general LFMG matrices Mm and Mmn to be 
of the type 

/ 0 ay 3 0 \ 

M n ~ M N3 ay 3 y 2 ay 2 (17) 

\ o ay 2 l ) 

and 

/ 0 py 5 0 \ 

Mnn — Mmn3 I Py 5 y 4 Py 3 I ■ ( 18 ) 

V 0 py 3 1 J 

We further take an extra condition of the type 

IA — 11 < y 2 (A = a,P) (19) 
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for both the order-one parameters a and (3 contained in the matrices Mjv and 
Mmn, according to which they are supposed to be equal to unity with a few 
percent accuracy. Substitution in the seesaw formula © generates an effective 
physical neutrino mass matrix M v of the form: 


M v ~ — 


^N3 


0 y 


i + (y- y 2 ) 2 
i - (y - y 2 ) 


MnN3 

The physical neutrino masses are then given by: 


0 

1 - (y 

1 



( 20 ) 


m v i 


m v 2 


(I _ M N3 . 

2 2 Mnn 3 ’ 


1 V5 M|f. 
k 2 2 Mnn3 


Ml 




( 21 ) 


The predicted values of the neutrino oscillation parameters are: 


sin 2 29 atm — 1) sin 2 20 sun ~ ^, £7 e3 ~ -^=y, ~ ^j-y 2 (22) 

in agreement with atmospheric and LMA-MSW solar neutrino oscillation data. 

The proportionality condition (|5|), which leads to the LFMG texture, is not 
so easy to generate from an underlying symmetry beyond the Standard Model. 
However Jon Chkareuli, Holger Nielsen and myself have recently shown Q] that 
it is possible to give a natural realisation of the LFMG texture in a local chiral 
SU (3) family symmetry model. 


3 Fermion Masses in the AGUT Model 

The AGUT model is based on a non-simple extension of the Standard Model 
(SM) with three copies of the SM gauge group—one for each family—and, in the 
absence of right-handed neutrinos, one extra abelian factor: G = SMG 3 x U(l)f, 
where SMG = SU( 3) x SU( 2) x C7(l). This AGUT gauge group is broken down 
by four Higgs fields S, W, T and £ to the usual SM gauge group, identified as 
the diagonal subgroup of SMG 3 . The Higgs field S has a vacuum expectation 
value (VEV) taken to be unity in fundamental (Planck) mass units, while W, T 
and £ have VEVs an order of magnitude smaller. So the pure SM is essentially 
valid, without supersymmetry, up to energies close to the Planck scale. The 
AGUT gauge group SMG 3 x £7(1)/ only becomes effective near the Planck 
scale, where the i’th proto-family couples to just the Pth SMG factor and 
U(l)f. The £7(1)/ charges assigned to the quarks and leptons are determined, 
by anomaly cancellation constraints, to be zero for the first family and all left- 
handed fermions, and for the remaining right-handed states to be as follows: 

Qf( T r)=Qf(bR)=Qf(cn) = l Qf(/j, r ) = Qf(sn) = Qf(t R ) = -l (23) 
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I refer to the review of the AGUT model by Holger and myself at the first Bled 
workshop Q for more details. 

The quarks and leptons are mass protected by the approximately conserved 
AGUT chiral gauge charges . The quantum numbers of the Weinberg-Salam 
Higgs field <fiws are chosen so that the t quark mass is not suppressed, whereas 
the b quark and r lepton are suppressed. This is done by taking the four abelian 
charges, expressed as a charge vector Q = ( yi/2 , 2 / 2 / 2 , y 3 /2,Qf), for (j>ws to be 
given by: 

Q*ws = Qc R - Qt L = ( 0 , 2 / 3 , 0 , 1 ) - ( 0 , 0 , 1 / 6 , 0 ) = ( 0 , 2 / 3 , - 1 / 6 , 1 ) ( 24 ) 

We assume that, like the quark and lepton fields, the Higgs fields belong to 
singlet or fundamental representations of all the non-abelian groups. Then, by 
imposing the usual SM charge quantisation rule for each of the SMG factors, the 
non-abelian representations are determined from the weak hypercharge quantum 
numbers yi. The abelian quantum numbers of the other Higgs fields are chosen 
as follows: 


Qw = (0, —1/2,1/2, —4/3) 

Qi = (1/6,-1/6,0,0) 


Qt = (0, —1/6,1/6, —2/3) 
Os = (1/6,-1/6,0,-1) 


(25) 

(26) 


Since we have < S >= 1 in Planck units, the Higgs field S does not suppress 
the fermion masses and the quantum numbers of the other Higgs fields W, T, 
£ and <j>ws given above are only determined modulo those of S. 

The effective SM Yukawa coupling matrices in this AGUT model can now be 
calculated in terms of the VEVs of the fields W, T and £ in Planck units—up to 
“random “ complex order unity factors multiplying all the matrix elements—for 
the quarks: 



( WT 2 ? 

WT 2 !; 

W 2 Ti \ 


/ W(T 2 ? 

WT 2 !; 

T 3 £ 

Y v ~ 

WT 2 ? 

WT 2 

W 2 T 

y d ~ 

WT 2 £, 

WT 2 

^ 3 


V 

1 

WT ) 


\ W 2 T 4 Z 

w 2 t 4 

WT 


(27) 

and the charged leptons: 

/ WT 2 ? WT 2 £ 3 WT 4 £ \ 

Y e ~ WT 2 £ 5 WT 2 WT 4 £ 2 (28) 

\ WT 5 £ 3 W 2 T 4 WT ) 

A good order of magnitude fit is then obtained jj| to the charged fermion masses 
with the following values for the Higgs field VEVs in Planck units: 


W = 0.179, T = 0.071 £ = 0.099. (29) 

We now consider the neutrino mass matrix in the AGUT model. 
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4 Neutrino Mass and Mixing Problem 


Without introducing new physics below the AGUT scale, the effective light neu¬ 
trino mass matrix M u is generated by tree level diagrams involving the exchange 
of two Weinberg-Salam Higgs tadpoles and the appropriate combination of W, 
T, £ and S Higgs tadpoles. In this way we obtain: 

U \2 / W 2 ?T 4 W 2 £T 4 W 2 ?T \ 

M v ~ W 2 £T 4 WT 5 W 2 T , (30) 

Mp l \ W 2^ T W 2 T W 2 T 2^2 J 

The off-diagonal element {M u ) 2 3 = {M v ) 32 dominates the matrix, giving large 
v T — Vp mixing with the following two neutrino masses and mixing angle: 

{<Pws? 


m 2 ~ m3 


-W 2 T 


sin 2 2 9^ T ~ 1 


(31) 


Af Planck 

Although the large mixing angle sin 2 2 d^ T is suitable for atmospheric neutrino 
oscillations, there are two problems associated with the neutrino masses. Firstly 
the ratio of neutrino mass squared differences Am 2 3 /Am 2 2 ~ 2 T? ~ 1.4x 10” 3 , 
whereas the small mixing angle (SMA) MSW solution to the solar neutrino 
problem requires Am 23 /Am 2 2 ~ 10 -2 . Secondly the predicted overall absolute 
mass scale for the neutrinos (4>ws) 2 /^Planck ~ 3 x 10 -6 eV is far too small. 

We conclude it is necessary to introduce a new mass scale into the AGUT 
model. Two ways have been suggested of obtaining realistic neutrino masses 
and mixings in the AGUT model: 

1. By extending the AGUT Higgs spectrum to include a weak isotriplet Higgs 
field A with SM weak hypercharge y/2 = —1 and a VEV (A 0 ) ~ 1 eV; 
also a new Higgs field ip giving large fj, — r mixing in the charged lepton 
Yukawa coupling matrix Ye is required. 

2. By including right-handed neutrinos and extending the AGUT gauge group 
to Gextended = ( SMG x U(1) B -l) 3 ': also two new Higgs fields 4>b-l and 
X are introduced to provide a see-saw mass scale and structure to the 
Majorana right-handed neutrino mass matrix. 

Yasutaka Takanishi reported on the second approach Q at the workshop; 
so I will report on the first approach || here. We must therefore consider 
the introduction of a new Higgs field ip, which can yield large mixing from the 
charged lepton mass matrix without adversely affecting the quark mass matrices. 
With the following choice of charges for the ip field 


= + Qw + 4 Qt = ^2’ 3’ 6’ ^ 

we obtain new expresssions for the quark Yukawa matrices: 

Yu = 


(32) 


/ WT 2 ^ 2 

WT 2 i 

W 2 Ti \ 

/ WT 2 ? 

WT 2 £ 

T 3 t \ 

WT 2 £ 3 

WT 2 

w 2 t 

Y d = WT 2 i 

WT 2 

T 3 

\ e 

1 

WT ) 

\ W 2 Tip 

W 2 T£4> 

WT / 


( 33 ) 
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and the charged lepton Yukawa matrix: 


/ WT 2 ? W 2 T 2 ip ?ip \ 

Y e = W 4 T^ 2 WT 2 £,ip . (34) 

\ W 3 ?ip W 2 TWT ) 


As we can see from the charged lepton matrix we will indeed have large mixing if 
(ip) = 0(0.1), so that (Ye) 23 ~ (Ye) 33 . In the following discussion we shall take 
ip to have a vacuum expectation value of (ip) =0.1 for definiteness. The effect 
of the field ip on the charged fermion masses is then small, since the elements 
involving ip do not make any significant contribution to the determinant, or the 
sum of the minors, of the mass matrices, or the trace of the squares YY^ of the 
Yukawa matrices. The mixings of the quarks is essentially unaffected by the 
terms involving ip, and the only significant effect is on the mixing matrix Ue, 
which is now given by: 



( 1 

M 2 x 

V$T 

MX 

1 

X 

e \ 

X 


( 1 

0.021 

6.4 x 10 ” 4 \ 

Ue ~ 

-Wip 

, M 2 

\ T 

1 

X 

1VT , 
MX / 


-0.016 
y 0.014 

0.75 

- 0.66 

0.66 

0.75 ) 


(35) 


where X = ?1 + W 2 T 2 /?ip 2 ~ 1.51 This gives the large mixing required, 
sin 2 26atm ~ 1 , for the atmospheric neutrino oscillations. 

We can further obtain a solution with vacuum oscillations for the solar neu¬ 
trinos by choosing appropriate charges for the isotriplet Higgs field A. We 
require a large off-diagonal ( 1 , 2 ) element for the neutrino mass matrix and 
hence we choose the charges on A to be 

Qa = (- 5 --' 44 ) ( 36 ) 

We then obtain the neutrino mass matrix, 

/ W? W? T?ip \ 

M v ~ (A 0 ) W? W T£ip . (37) 

V ?e*p Ttpip T 2 ^ip ] 

This has the eigenvalues, 

mr ~ (A 0 ) (--T?iP + , m 2 ~ <A°)W, m 3 ~ (A 0 ) (t?iP + 

(38) 

where the splitting between m\ and m 2 comes from the mass matrix element 
(M„) 33 . The neutrino mixing matrix is then given by, 


U v 


( A* 1 -*) \ 


(39) 



Hence, using Ue from eqn. |35|, we have the lepton mixing matrix U = U' E U V : 



/ 

V^ 1 + 

-W£ 

V 2 ^ 4^ 

\ 

( 0.83 

-0.016 

0.58 \ 

17 ~ 


vkd-i) 

WT 

WX 



~ 0.38 

0.75 

-0.55 


l 

WT( l-£) 

1 

wt(i+£) 

) 

V -0.43 

0.66 

0.62 / 


V 2 (i/>X 

X 

V 2 ^X 





( 4 °) 

which, as we can see, has large electron neutrino mixing, as we require for a 
vacuum oscillation solution to the solar neutrino problem. 

We also have the mass hierarchy, 


Am ? 3 
A m | 3 


W 2 


3 x 10“ 


(41) 


Hence, if we then take (A 0 ) ~ 0.2 eV, so that we have an overall mass scale 
suitable for the atmospheric neutrino problem, then we will also have, 

Am 2 13 ~ 2(A °) 2 T 3 Z 3 ip 2 ~ 3 x 10" lo eV 2 . (42) 

With such a hierarchy of Am 2 s we effectively have two-neutrino oscillations for 
the solar neutrinos, with the mixing angle given by, 

-,2 _ a tt2 tt 2 


sin 2 2 9 sun = AU 2 el U 2 e3 


0.9. 


(43) 


So, we have the ‘just-so’ vacuum oscillation solution to the solar neutrino prob¬ 
lem with large electron neutrino mixing. We remark that U e 2 = —0.016 satisfies 
the CHOOZ electron neutrino survival probability bound (U e 2 is the relevant 
mixing matrix element, since Am 32 ~ Am| 3 Am 2 3 ). 

It is also possible to obtain a small mixing angle SMA-MSW solution to the 
solar neutrino problem, with a different choice of charges for A: 


Qa ( 2 , 3, 6 ,o) 

which gives the quasi-diagonal neutrino mass matrix 

/ W 4 TZ 2 ip 2 WT 2 £, 3 T 3 Z 2 ip 

M v ~ (A 0 ) WT 2 £ 3 WT 2 WTt; 2 

\ T 3 Z 2 ip WT£ 2 

The mixing matrix U v for this mass matrix is given by, 


/ 


U v 


V - t3 ^ - * 

Thus we obtain the lepton mixing matrix: 

/ 1 -Wip &- 



U = ulu v 


ivx 

T 


T 

WT _ J_ 
$il>X X 


_i_ A WT 

\ X X fibX 



0.016 

0.75 

0.66 


(44) 


(45) 


(46) 


0.014 \ 
-0.66 
0.75 J 


(47) 
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Taking (A 0 ) ~ 3 eV, we then obtain suitable masses and mixings for the solution 
of both the solar and atmospheric neutrino problems: 

sin 2 2 9 a tm ~ 1 Am 2 3 ~ 1 x 10“ 3 eV 2 sin 2 2 9 sun ~ 1 A m\ 2 ~6x 10 _6 eV 2 

(48) 

We did not manage to find an LMA-MSW solution, which is favoured by 
the latest solar neutrino data from Sudbury and SuperKamiokande, using this 
approach. However, during this workshop, Holger, Yasutaka and I constructed 
a promising LMA-MSW solution |J using the extended version of the AGUT 
model with right-handed neutrinos and the usual see-saw mechanism. 
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